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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

[1] A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 
CFR 1.17(e), was filed in diis application after final rejection. Since this application is eligible for 
continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely 
paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. 
Applicant's submission filed on September 2, 2008 has been entered. 

Response to Arguments/ Amendments 

[2] Presented arguments have been fully considered, but are rendered moot in view of the new 
ground(s) of rejection. 

Claim Rejections - 35 USC §101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any 
new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of 
this tide. 

[3] Claims 36-48 are rejected under 35 U.S.C. 101 as not falling widtin one of the four statutory 
categories of invention. Supreme Court precedent 1 and recent Federal Circuit decisions 2 indicate 
that a statutory "process" under 35 U.S.C. 101 must (1) be tied to another statutory category (such 
as a particular apparatus), or (2) transform underlying subject matter (such as an article or material) 

1 Diamond v. Diehr, 450 U.S. 175, 184 (1981); Parker v. Flook, 437 U.S. 584, 588 n.9 (1978); Gottschalk v. 
Benson, 409 U.S. 63, 70 (1972); Cochrane v. Deener, 94 U.S. 780, 787-88 (1876). 

2 In re Bilski, 88 USPQ2d 1385 (Fed. Cir. 2008). 
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to a different state or thing. While the instant claim(s) recite a series of steps or acts to be 
performed, the claim(s) neither transform underlying subject matter nor positively tie to another 
statutory category that accomplishes the claimed method steps, and therefore do not qualify as a 
statutory process. The claims recite process steps without being tied to an apparatus/ system, such as 
a computer or processor. 

Claim Rejections - 35 USC §102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall he eniiiled i< > ;i paicni unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the United States 
before the invention thereof by the applicant for patent, or on an international application by another who has 
fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before the invention thereof by 
the applicant for patent. 

The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act of 1999 
(AIPA) and the Intellectual Property and High Technology Technical Amendments Act of 2002 do 
not apply when the reference is a U.S. patent resulting direcdy or indirectly from an international 
application filed before November 29, 2000. Therefore, the prior art date of the reference is 
determined under 35 U.S.C. 102(e) prior to the amendment by the AIPA (pre-AIPA 35 U.S.C. 
102(e)). 

[4] Claims 23, 25, 26, 28-33, 36, 38, 39 and 41-46 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Toklu et al. ("Toklu") [US 6,549,643 Bl]. 



Regarding claim 23, Toklu meets the claim limitations, as follows: 
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A key-frame extraction system [Jig. 1], comprising: video frame extractor (i.e. 12) that 
extracts each of a series of video frames (i.e. segments) from a video (fig. 1; col. 5, 11. 39- 
44]; a set of frame analyzers (i.e. 15, 16, 17) that obtain the series of video frames in 
parallel from the video frame extractor (i.e. 12), each frame analyzer selecting a 
corresponding set of candidate key-frames from the series by performing a different 
corresponding analysis on each video frame in the series such that the analyses are 
selected to detect multiple types of meaningful content in the video [fig. 1; col. 5,1. 61- 
col. 6, I. 7]; key-frame selector (i.e. 18) that obtains the corresponding candidate key- 
frames from each frame analyzer (i.e. 15, 16, 17) and arranges the candidate key- 
frames into a set of clusters (i.e. segments) and that selects one of the candidate key- 
frames (i.e. reference key frame) from each cluster (i.e. segment) as a key-frame for the 
video fig. 4; col. 13, 11. 60-66]. 

Regarding claim 25, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the key-frame selector (i.e. 18) 
selects the key- frames by determining an importance score (i.e. object motion) for each 
candidate key-frame in each cluster (i.e. segment) [fig. 4; col. 13, 11. 60-66]. 

Regarding claim 26, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 25, wherein the key-frame selector (i.e. 18) 
determines the importance scores (i.e. object motion) bv determining an image content 
(i.e. region segmentation) of each candidate key-frame [fig. 4; col. 13, 11. 37 AO]. 
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Regarding claim 28, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the key-frame selector (i.e. 18) 
selects the key- frames by determining an image quality (i.e. object //jo/ ion) for each 
candidate key-frame in each cluster (i.e. segment) jig. 4; col. 13, 11. 60-66]. 

Regarding claim 29, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 
color histogram analyzer (i.e. 17) (fig. 1]. 

Regarding claim 30, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 
color layout (i.e. ilis/rib/i/ion or Liislog\in/) analyzer (i.e. 17) [fig. 1]. 

Regarding claim 31, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 
fast camera motion detector (i.e. 15) [fig. 1]. 

Regarding claim 32, Toklu meets the claim limitations, as follows: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 
camera motion tracker (i.e. 15) [fig. 1J. 

Regarding claim 33, Toklu meets the claim limitations, as follows: 
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The key-frame extraction system of claim 23, wherein the frame analyzers include an 
object motion analyzer (i.e. 15) [fig. 1J. 



Regarding claims 36, 38, 39 and 41-46, all claimed limitations are set forth and rejected as per 
discussion for claims 23, 25, 26 and 28-33. 



Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



[5] Claims 24, 27, 34, 37, 40 and 47 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Toklu in view of Wu et al. ("Wu") [US 2003/0068087 Al]. 



Regarding claim 24, Toklu meets the claim limitations as set forth in claim 23. 

Toklu does not explicitly disclose the following claim limitations: 

The key-frame extraction system of claim 23, further comprising an audio event 
detector that obtains the series of video frames from the video frame extractor and 
that selects a corresponding set of candidate key-frames from the series by 
performing an audio analysis on each video frame in the series and that provides the 
corresponding set of candidate key-frames to the key- frame selector. 
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However, in the same field of endeavor Wu discloses the deficient claim limitations, as 
follows: 

The key-frame extraction system of claim 23, further comprising an audio event 
detector (i.e. 501) that obtains the series of video frames from the video frame 
extractor (i.e. 40) and that selects a corresponding set of candidate key-frames (i.e. 
frames with human sounds) from the series by performing an audio analysis on each 
video frame in the series and that provides the corresponding set of candidate key- 
frames (i.e. frames irillj l.uiman sounds) to the key-frame selector (i.e. 503) [paras. 0027 and 
0041]. 

It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Toklu with Wu to include audio analysis the motivation being to 
reduce the amount of image processing performed on the video data fpara. 0026]. 

Regarding claim 27, Toklu meets the claim limitations as set forth in claim 25. 

Toklu does not explicidy disclose the following claim limitations: 

The key-frame extraction system of claim 25, wherein the key-frame selector 
determines the importance scores by determining an audio content of each candidate 
key-frame. 

However, in the same field of endeavor Wu discloses the deficient claim limitations, as 
follows: 

The key-frame extraction system of claim 25, wherein the key-frame selector (i.e. 503) 
determines the importance scores (i.e. whether or not to process the frame) by determining 
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an audio content (i.e. human sounds) of each candidate key-frame paras. 0027 and 
0041 j. 

It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Toklu with Wu to include audio analysis the motivation being to 
reduce the amount of image processing performed on the video data [para. 0026]. 

Regarding claim 34, Toklu meets the claim limitations as set forth in claim 23. 
Toklu does not explicitly disclose the following claim limitations: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 

human face detector. 

However, in the same field of endeavor Wu discloses the deficient claim limitations, as 
follows: 

The key-frame extraction system of claim 23, wherein the frame analyzers include a 

human face detector (i.e. 503) [para. 0031]. 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Toklu with Wu to include face detection the motivation being 
human faces are most important users of video content [para. 0005]. 

Regarding claims 37, 40 and 47, all claimed limitations are set forth and rejected as per 
discussion for claims 24, 27 and 34. 
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[6] Claims 35 and 48 are rejected under 35 U.S.C. 103(a) as being unpatentable over Toklu in 
view of Dimitrova et al. ("Dimitrova") [US 6,125,229]. 



Regarding claim 35, Toklu meets the claim limitations as set forth in claim 23. 

Toklu does not explicitly disclose the following claim limitations: 

The key-frame extraction system of claim 23, further comprising a user interface for 
displaying a set of video frames in the video previous to each key-frame and a set of 
video frames in the video subsequent to each key-frame and for obtaining a user 
selection of one or more of the video frames 

However, in the same field of endeavor Dimitrova discloses the deficient claim limitations, 

as follows: 

The key-frame extraction system of claim 23, further comprising a user interface for 
displaying a set of video frames in the video previous to each key-frame and a set of 
video frames in the video subsequent to each key-frame and for obtaining a user 
selection of one or more of the video frames [col. 12, 11. 59-67] 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Toklu with Dimitrova and include user input the reasoning being 
that user's desire should be taken into account. 



Regarding claim 48, all claimed limitations are set forth and rejected as per discussion for 
claim 35. 
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Contact Information 

[7] Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Mr, Sath V. Perungavoor whose telephone number is (571) 272-7455. The 
examiner can normally be reached on Monday to Friday from 8:30am to 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Mr. Matthew C. Bella whose telephone number is (571) 272-7778, can be reached on Monday to 
Friday from 9:00am to 5:00pm. The fax phone number for the organization where this application 
or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Dated: January 1,2009 
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